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Introduction 


References  [1]  -  [6]  list  a  few  of  many  papers  concerned 

with  evaluating  the  multivariate  normal  integral.  I  have  singled  out 
these  because  part  of  each  of  them  is  devoted  to  the  problem  of  obtaining 
a  particular  type  of  reduction  formula  for  the  normal  integral  -  writing 
it  in  terms  of  more  tractable  normal  integrals.  In  spite  of  the  apparent 
variety  of  results  and  methods  of  these  papers,  they  all  give  formulas 
which  are  actually  simple  applications  of  the  convolution  formula  (1)  given 
below.  The  purpose  of  this  note,  then,  is  to  point  out  that  a  number  of 
reduction  formulas,  derived  with  various  degrees  of  difficulty  in  the 
literature,  are  special  cases  of  formula  (1),  and  to  point  out  that  many 
more  reduction  formulas  easily  follow  from  (1).  The  ease  with  which 
formulas  may  be  derived  suggests  that  most  of  them  are  mere  curiosities, 
and  of  little  value  for  numerical  work,  but  the  general  applicability  of 
the  formula  makes  it  worth  having  as  a  tool  for  attacking  particular  normal 
distributions  with  given  covariance  matrices.  In  addition,  from  a  variety 
of  representations  of  a  normal  integral  as  an  expectation,  one  would  hope 
to  be  able  to  choose  one  with  small  variance  for  Monte  Carlo  estimates. 

2.  The  Formula 

If  X  and  y  are  independent  random  variables  with  distributions 
F  and  G,  then  the  distribution  of  x  +  y  may  be  expressed  in  this  form; 

P[x+y  <  a]  =  JpCx  <  a-y|y]dG  =  C{F(a-y)} 


where  is  expectation. 


This  same  form  of  the  convolution  formula  applies 
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if  !^  =  (x^,...,x^)  and  t)  =  (y^i..  .ty^)  are  independent  Ixn  vectors  - 
if  a  =  and  F(a)  =  PC^  <  a]  =  PCx^  <  a^,...,x^  <  a^] ,  then 

P[i;+t1  <  a]  =  C{F(a-T})]. 

Now  let  cov(J^)  =  A  mean  that  A  is  the  covariance  matrix  of  the  vector  H. 
If  5  and  T|  are  independent  Ixn  vectors  of  zero  mean  normal  random 
variables  with  cov(5)  =  A  and  cov(ti)  =  B  then  cov(J^+ti)  =  A+B,  and  if 
we  let  F(A,a)  =  PC^  <  a],  then 

F[A+B,a]  =  PC^+Ti  <  aj  =  e[F(A,a-Ti)) 

This  formula  may  be  used  to  give  most  of  the  reduction  formulas  reported 
in  the  literature,  so  we  state  it  precisely. 

Let  F(A,a)  ^  the  n-dimensional  normal  distribution  ^ 

F(A,a)  =  PC?  <  a]  =  P[x^  <  , 

where  I,  =  (x^ , . . .  and  the  x's  are  .jointly  normal  with  zero  means 

and  covariance  matrix  A.  Then 

(1)  F(A+B,a)  =  e[r(A,a-ii)} 

where  ti  =  (y^^, . . .  ly^j)  12.  a  zero  mean  normal  vector  with  cov(ti)  =  B. 

3.  Some  Notation 

Let  i  be  the  standard  normal  integral,  so  that 
F(I,a)  =  f(a^)$(a2)  ... 

and  let  H  be  the  Heaviside  function,  or  the  characteristic  function  of 
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the  positive  orthant  -  if  p  =  *’^10^  then  H(p)  =1  if  p  >  0 

or  H(p)  =  O  otherwise.  For  a  partitioned  covariance  matrix  with 

R  0 

blocks  of  zeros,  q) ,  and  a  partitioned  vector  (a,P),  we  have 

(2)  F[(q°),  (a,p)]  =  F(R,a)H(p). 

Also  note  that  if  v  is  the  vector  of  all  l*s,  v  =  (1,...,1),  then 
F(v'v,a)  =  f  Cmin(aj^, . . .  ,a^)]  , 

since  if  y  has  distribution  $,  then  yv  =  (y,y,.-.,y)  has  covariance 
matrix  v'v.  In  general,  if  cov(ti)  =  B,  then  cov(iiM)  =  M'BM. 

4.  Applications 

We  give  some  examples  of  the  use  of  (1).  Suppose  that  A  is 
non-singular.  Multiplying  by  a  constant  if  necessary,  we  may  assume 
that  the  smallest  characteristic  root  of  A  is  1.  Then  A  has  a 

representation  A  =  I+T'T  where  T  is  kxn  of  rank  k  <  n.  The 
multiplicity  of  the  root  1  is  n-k.  Then 

F(A,a)  =  F(I+T'T,a)  =  e{F(I,a-CT)} 

where  ^  has  zero  means  and  covariance  I.  Hence  if 

columns  of  T, 

1  £1  n  ’ 


(3) 


F(A,a)  =  F(I+T'T,a)  =  .  .  .^(a^-uT;^)} 
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A  particularly  easy  example  of  (3)  is  when  k  =  1,  so  that 
A  =  I+T'T,  with  T  =  ( tj^ , . . .  ,t^)  .  Then 

(4)  F(I+t»t  a)  =  +t  z) f(a  +t  z) . . , f(a  +t  z)] 

11  d  d  n  n 

with  z  having  distribution  Formula  (3)  includes  results  of 

Das  [2],  Moran  C5],  and  Stuart  [62  ;  Ihm  [3]*  went  to  some  length 
to  establish  a  version  of  (4). 

Again  multiplying  by  a  constant  if  necessary,  we  may  assume  that 
A-u'v  is  non-negative  definite,  where  once  again  v  =  (1,1,...,1). 
Then 

F(A,a)  =  F(  A-v’ v+v'v,a)  =  Cf  F(  v '  v,a-Ti ) } ,  cov(ti)  =  A-v'v, 

Hence 

F(A,a)  =  ^{$[min(a^-y^,a2-y2, . . .  ]} 

where  y^i...,yj^  are  normal,  zero  means,  covariance  A-v'v.  More 

generally,  if  we  write  A  =  A-y'y+y'Y  in  such  a  way  that  A-y'y  is 
non-negative  definite,  with  y  =  (c^,.,.,c^),  then 

F(A,a)  =  C{F(Y'Y,a-^)3 ,  cov(ti)  =  A-y'y. 

It  is  easy  to  deal  with  F(y'y,  )  for  example,  if  all  the  c's  are 
positive, 

F(A,a)  =  C{F(Y'Y,a-Ti)}  =  [min(c“^a^-c”V^  , . .  .  ,c”^a^-c"V„) 

where  y-j^t-.-iy^^  are  normal,  zero  means,  covariance  A-y'y.  We  may 
always  choose  y  so  that  A-y'Y  has  rank  less  than  that  of  A. 


% 


I 
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Another  type  of  reduction  formula  involves  integrals  over 

half-infinite  intervals.  To  develop  these,  let  the  composite  zero 

AB' 

mean  normal  vector  have  covariance  ),  with  cov(i^)  =  A 

and  cov(ti)  =  C.  Assume  C  ^  exists.  Now  write 


PC(!^,ti)  <  (a,p)]=  F[(g®'),  (a, 3)3  =  FC(^' 


'C 


0.  .B 


'C“^B 


),(a,p)], 


then  use  (1)  to  get 

—1  —1  B*c"*^B  B* 

since  the  vector  (t|C  B,ti)  =  Tj(C  B,I)  has  covariance  (  q  ^  ) 

B  O 

if  T|  has  covariance  C.  Using  (2)  to  remove  the  blocks  of  zeros,  we 
have  our  result: 


(5)  FC(^'),(a,3)]  =  efF(A-B'C"^B,a-TiC"^B)H(3-Ti)1  ,  cov(ti)  =  C. 

Special  cases  of  (5)  are  reported  in  [1]  and  [4].  Note  also  that 
(5)  may  be  used  to  establish  that  the  conditional  mean  and  covariance 
of  given  t]  ,  are  nC  and  A-B'C  ^B.  We  can,  in  fact,  give 

a  more  general  form  of  (5)  which  does  not  require  that  C  ^  exist  and 
which  will  give  the  most  general  formulas  for  conditional  meatn  and 
covariance.  Let  be  the  psuedo  inverse  of  C,  that  is,  if  C  =  T'T 

with  T  rxm  of  rank  r,  then  =  T'(TT')  ^T,  alternatively, 

=  RR'  where  R  =  T'(TT')  ^  is  the  principal  right  inverse  of  T, 
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Using  (1),  we  have 


FC(^'),  (a,P)]  =  ^),  (a-nC-^B,  p-ti)]} 


A-B*C+B  Ov 


since  the  vector  (t)C^B,ti)  =  t)(C^B,I)  has  covariance  ( 


B'C  B  B' 
B  C 


). 


(A  direct  calculation  shows  that  the  covariance  is  (^^2  ^  »  where 

E  =  T'(TT')  4  is  the  projector  of  the  row  space  of  C.  But  CE  =  C, 

and  hence  for  any  matrix  H  whose  rows  are  in  the  row  space  of  C,  HE  =  H. 

In  particular,  B'E  =  B' ,  since  the  rows  of  B'  lie  in  the  row  space  of 

C.  To  prove  this  last  contention,  note  that  any  covariance  matrix  may  be 

S'  S '  S  S  ’  V 

assumed  to  have  the  form  (,r|)  (SV)  =  („io  rows  of  S'V 

V  V  o  V  *  V 

lie  in  the  row  space  of  V'V,  which  is  the  row  space  of  V.) 

Using  (2)  to  remove  blocks  of  zeros,  we  have  a  more  general  form  of  (5) ! 

(6)  F[(^'),(a,p)3  =  fifFU-B'C*B,a-TiC'^B)H(p-Ti)},  cov(ti)  =  C. 

From  (6)  follows  the  general  formula  that  the  conditional  mean  and  covariance 
of  given  ti,  are  tiC^B  and  A-B'C*B. 
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